Evaluating Algorithmic Techniques in Supporting Situation Awareness

How well does an algorithm support its purpose and user base? Has automation provided the user with the ability to augment their production, quality or responsiveness? In a number of systems today these questions can be answered by either Measures of Performance (MOP) or Measures of Effectiveness (MOE). However, the fusion community has not yet developed sufficient measures and has only recently devoted a concerted effort to address this deficiency. In this paper, we will summarize work in metrics for the lower levels of fusion (object ID, tracking, etc) and discuss whether these same metrics still apply to the higher levels (Situation Awareness), or if other approaches are necessary. We conclude this paper with a set of future activities and direction.